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(57) Abstract: The visibility of an image displayed on a screen of a 
multi-screen display is manipulated by controlling the transparency 
or opacity of the image, or of related image elements. For exam- 
ple, the alpha value of the image, or of overlapping image elements 
on other screens, can be controlled. The visibility can also be en- 
hanced via controlling the characteristics of a mask or a shadow, on 
the same or a different screen layer as the image. 
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METHOD OF MANIPULATING VISIBILITY OF IMAGES ON A VOLUMETRIC 

DISPLAY 

FIELD OF THE INVENTION 

The invention relates to a method of manipulating the visibility of image 
elements on the screens of a multi-screen display. 

BACKGROUND 

5 Multi-screen displays including two or more screens in a stacked arrangement 
are known. An example of such a screen is disclosed in PCT/NZ98/00098. 
Multi-screen displays are capable of displaying image elements on multiple 
screens at the same time. 

In practice, most multi-screen displays are dual screen displays having a front 
10 and rear screen in a stacked arrangement. At least a part of front screen must 
be capable of being made transparent so that images on the rear screen can be 
seen through it. In addition, at least a part of the front screen should be 
capable of becoming opaque, so that images on the rear screen could not be 
seen through it. 

15 In this latter case, the inherent transparency of an LCD screen is problematic. 
LCD screens cannot be made to be 100% opaque. Accordingly, there will be 
leakage of images displayed on the rear screen through the front screen. 
Where image elements are displayed on more than one screen they may 
overlap and interfere with each other. This can be distracting. 

20 Each pixel in an LCD screen stores values for colour and an additional value 
between 0 and 1 {alpha value). The alpha value determines how opaque or 
transparent the image element is in relation to other image elements that are 
displayed over the same pixels. For example, 40% alpha value for an image 
element will mean that it is 60% transparent (or 40% opaque). 

25 All references, including any patents or patent applications cited in this 
specification are hereby incorporated by reference. No admission is made that 
any reference constitutes prior art. The discussion of the references states 
what their authors assert and the applicant reserve the right to challenge the 
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accuracy and relevance of the cited documents. It will be clearly understood 
that, although a number of prior art publications are referred to herein; the 
reference does not constitute an admission that any of these documents form 
part of the common general knowledge in the art, in New Zealand or in any 
other country. 

It is acknowledged that the terms 'comprise', 'comprises' and 'comprising' may, 
under varying jurisdictions, be attributed with either an exclusive or inclusive 
meaning. For the purpose of this specification, and unless otherwise noted, the 
terms 'comprise', 'comprises' and 'comprising' shall have an inclusive meaning 
- i.e. they will be taken to mean an inclusion of not only the listed components it 
directly references, but also other non-specified components or elements. 

OBJECT OF THE INVENTION 

It is an object of the present invention to provide a method to manipulate the 
visibility of image elements on the screens of a multi-screen display, or to at 
least provide a useful choice. 

STATEMENT OF INVENTION 

In one aspect the invention relates to a method of manipulating the visibility of a 
target image element displayed on a screen of a multi-screen display including 
the steps: 

a) Selecting at least one target image element; 

b) Identifying the screen on which the target image element is displayed 
and the position of the target image element on the screen; 

c) Manipulating the transparency of the target image element to the desired 
level, using one or more of the following: 

a. Manipulating the characteristics of the target element image to 
adjust its transparency; 
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b. Identifying partially overlapping image elements in substantially 
the same position on a different screen to the target image 
element and manipulating the characteristics of the overlapping 
image elements to adjust the transparency of the target image 
element; 

c. Placing a supporting image element in substantially the same 
position on the same or different a screen from the target image 
element. 

Preferably the characteristics of the image elements to be manipulated are 
selected from, but not limited to, alpha values; colour; hue; saturation; 
brightness; or RGB values. 

Preferably the supporting image element is a shadow or a mask. 

Preferably the selection of the target image element may be conducted by a 
user or a software programme. 

Preferably where the target image element is displayed on the front screen, its 
visibility may be increased by: 

a) Increasing the alpha value of the target image element; 

b) Decreasing the alpha value of any overlapping image elements; 

c) Introducing, or increasing the alpha value of, a shadow on a screen 
behind the target image element; 

d) Decreasing the alpha value of any mask overlapping the target image 
element on the front screen; or 

e) Any combination of a) to d). 

Preferably where the target image element is to be displayed on the rear 
screen, its visibility may be increased by: 
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a) Increasing the alpha value of the target image element; 

b) Decreasing the alpha value of any overlapping image element; 

c) Introducing or increasing the alpha value of a mask on a screen in front 
of the rear screen; 

d) Decreasing the alpha value of any shadow overlapping the target image 
element on the rear screen; or 

e) Any combination of a) to d). 

These techniques may be used for one or more image elements depending on 
the effect desired. 

The method may affect all image elements on a screen or it may be limited to 
selected image elements or parts thereof. 

Many methods of selecting image elements are known. These are useable in 
this invention. 

Preferably the methods described above will be incorporated into an electronic 
form such as a software programme. 

In this specification the following terms have the meanings set out below: 

Image Element: Any visual item generated for a display. By way of example, 
this may comprise a series of windows, a single window or other components 
whether or not they are within a window. 

Shadow: An image element positioned substantially behind a target image 
element on a multi-screen display screen. The shadow is formed from a solid 
colour which affects the visibility of the image element positioned on a screen in 
front of that image element. In the case of an LCD the preferred colour for the 
shadow is white. Other screen technologies or effects may require different 
colours. 
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Mask: An image element positioned substantially in front of a target image 
element on a multi-screen display screen. The mask is formed from a solid 
colour which affects the visibility of a target image element and is positioned on 
a screen in front of the target image element. In the case of an LCD the 
5 preferred colour for the mask is white. The white portions of an LCD are 
transparent. Accordingly, where the front screen of the multi-screen display is 
an LCD the mask is formed by colouring the masking image element white. 
Other screen technologies or effects may require different colours or techniques 
to achieve the requisite transparency. 

10 Alpha Value: An image element stores information for each pixel that is involved 
in the final display. Each pixel stores values for colour and an additional value 
between 0 and 1. This value is the alpha value. The alpha value determines 
how opaque or transparent the image element is in relation to other image 
elements that are displayed over the same pixels. For example, 40% alpha 

1 5 value for an image element will mean that it is 60% transparent. 

Actual Transparency: The transparency of an image element within a single 
screen is determined solely by the alpha value. 

Apparent Transparency: The transparency of an image element perceived from 
a multi-screen display user's point of view. This is a cumulative effect resulting 
20 from by way of example, the Actual Transparency, masking and shadowing 
effects used on the individual screens of multi-screen displays. 

Multi-Screen Display: a display having at least two screens in a stacked 
arrangement. 

Screen(s): a physical display layer of a display device, such as an LCD panel. 

25 In the following description reference is made to a dual screen display where 
both screens are LCDs. The methods of the invention are applicable to any 
multi-screen display where the front screen or screens are capable of becoming 
at least partially transparent. Suitable technologies for use as the front screen 
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of a multi-screen display include, by way of example, LCDs, TOLEDs or 
monochrome plasma screens. 

In the following description, reference is made to white masking. Displaying 
white on a LCD renders the "white" portion of the display transparent Where 
5 the front screens are not LCD a different mechanism, eg a different colour, may 
be required to achieve transparency. This mechanism may be used in place of 
the white masking to effect the method of the present invention. 

Further aspects of the present invention will become apparent from the 
following description which is given by way of example only and with reference 
1 0 to the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 Shows the transition between two extreme states where the 
viewer can see an object in the front screen at varying levels of 
apparent transparency. 

Figure 2 Shows the ability to cut through masking objects in the front 
screen to completely show an object in the back screen 

DETAILED DESCRIPTION 

The invention will be described with reference to a dual screen display having 
two LCD panels in a stacked arrangement. As will be appreciated by those 
15 skilled in the art the invention is readily adaptable to displays having more than 
two screens. 

Figure 1 shows the transition between two extremes. In the first state, shown in 
Figure 1a, a target image element is displayed on the front screen. The 
corresponding area on the rear screen is shadowed in white. This gives the 
20 target image element an opaque appearance. In the other extreme state 
(shown in Figure 1f) the alpha value of the white shadow is reduced to zero and 
the target image element appear less visible. 
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The transition between these two states has two main phases: 

1. Shadow Fade Out: The alpha value of the white shadow on the rear 
screen decreases. The other image elements on the rear screen that 
share the same pixels as the white shadow become more visible. 

2. Mask Fade In: A white mask is placed over the image element in the 
front screen. The alpha value of the white shadow is gradually increased 
from 0% to 1 00%. As this happens, other image elements in the front 
screen that share the same pixels as the white mask become less 
visible. 

The shadow on the rear screen is made more transparent by decreasing its 
alpha value. As the alpha value tends to zero the shadow becomes more 
transparent. As the shadow is made more transparent, the image on the back 
screen becomes more visible. This has the effect of making it appear that the 
element on the front screen is becoming more transparent. In fact the alpha 
value of the element on the front screen is constant. 

In some circumstances, increasing the visibility of image elements on the rear 
screen may have the effect of increasing the apparent transparency of an 
overlapping target image on the front screen. 

Where the alpha value of the image element on the front screen is decreased 
the selected image element on the front screen becomes more transparent. If 
there are multiple overlapping image elements on the front screen, decreasing 
the alpha value of the selected image element will increase the visibility of the 
other image elements on the front screen. If the other image elements are 
predominantly white or there are no other image elements then the image 
element displayed on the rear screen may become more visible. 

An alternative way of achieving this effect is to place a white mask over the 
image element on the front screen. White on the front screen is transparent. 
So, as the alpha value of the white mask increases to 100%, the apparent 
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transparency of the mask would increase. This would enable the image on the 
rear screen to be clearly visible through the front screen. 

The stages transiting the shift from the opaque front screen to a complete 
apparent transparency are shown in Figure 1. In this case the alpha value of 
5 the white shadow on the rear screen is decreased and then a mask is placed in 
front of the image element on the front screen. The alpha value of this mask 
can be increased to increase apparent transparency. This renders the masked 
portion of the front screen transparent making the image element on the rear 
screen easily viewable. This is indicative of one embodiment of the method 
10 however the invention is not limited simply to this. 

In addition, it will be appreciated that the process can be reversed to render an 
image element on the front screen visible in preference to an image element on 
the rear screen. 

In Figure 1a, an image element is displayed on the front screen of a dual screen 
15 display. The image element has a high alpha value, for example 100%. On the 
rear screen is a white shadow corresponding with the image element. The 
white shadow also has a high alpha value of, for example 100%. 

The effect of this combination is that the image element on the front screen 
appears to be completely opaque. No image is visible through the image 
20 element. 

In Figure 1b the alpha value of the white shadow decreases, for example to 
50%. As this occurs the image element behind the white shadow on the rear 
screen becomes more visible. The alpha value of the image element on the 
front screen remains unchanged. That is its actual transparency remains 
25 unchanged. 

The combined effect of these actions is that the image element on the front 
screen appears to be partially transparent. In fact, its actual transparency is 
unchanged. 
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In Figure 1c the alpha value of the white shadow is decreased to 0%. The 
image element behind the white shadow on the rear screen is completely 
displayed on that screen. The alpha value of the image element on the front 
screen remains unchanged. That is its actual transparency remains 
unchanged. 

The effect of this combination however, is that the image element appears even 
more transparent. In fact its actual transparency is unchanged. 

In Figure 1d, a white mask is placed in front of the image element on the front 
screen. The white mask has an alpha value of 0%. Accordingly it has no effect 
on the appearance. 

In Figure 1e, the alpha value of the white mask is increased to 50%. The alpha 
value of the image element is unchanged. However the white mask renders the 
screen partially transparent. The alpha value of the white shadowing on the 
rear screen remains at 0%. 

The effect of this combination is that the image element appears to be more 
transparent. So the image element on the rear screen is more easily viewed. 

In Figure 1f, the alpha value of the white mask is 100%. Again the alpha value 
of the image element is unchanged. The image element is completely hidden 
from view by the effect of the white mask. 

The effect is that the portion of the front screen including the image element is 
completely transparent. The image element on the rear screen is easily viewed 
through the front screen. 

As will be appreciated, for clarity the transit has been described with the 
increasing transparency of the shadow and the image element on the front 
screen occurring as separate and discrete events. This need not be the case. 
It is possible the alpha value of the image element on the front screen may be 
decreased before or while the alpha value of the white shadow is decreasing. 
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Similarly the inclusion of the white mask in front of that image element may 
begin while the alpha value of the white shadow is decreasing. 

Manipulating the relative transparency of image elements on the front and rear 
screens will enable a user to select which image elements on each screen are 
clearly visible. Different image elements can be selected and made visible with 
ease. This is particularly advantageous where comparisons are being made 
between different documents or image elements. 

The software is set up so that selection and changes in transparency are 
preferably manipulated by user input, for example keystrokes or mouse 
movements. In the preferred embodiment these are configurable by the user. 
It is envisioned that these may be automated to a greater or lesser extent by the 
use of a software programme. 

Another way to achieve visibility of target image elements is to make any 
overlapping image element transparent. 

This method is outlined in Figure 2. The method is directed to situations where 
the selected image element is located on the rear screen and involves: 

a) Detecting the position of the selected image element; 

b) Determining whether there is an image element on the front screen 
which is in a corresponding position with the position of the selected 
image element; 

c) Identifying any intersecting area; and 

d) Placing a white mask over the intersecting area on the front screen 
transparent. 

The intersecting area can be made transparent by placing a white mask over it. 
The use of white on the front screen of a multi-screen display has the effect of 
rendering the 'white' portion transparent. By placing a white mask over the 
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intersecting area the image element displayed on the rear screen becomes 
visible. This is clearly seen in Figure 2b. 

As can be seen on Figure 2 the effect is to display the selected image element 
in preference to other intersecting image elements. 

5 Where the background on the front screen is white, transparency may be 
achieved by changing the alpha value of any overlapping image element to 
zero. In this case the overlapping image element will become transparent. The 
white background will then dominate. As white on the front screen of a multi- 
screen display is transparent, the selected image element on the rear screen 
1 0 will be visible through the front screen. 

For clarity, this description has referred to single target image elements. 
However, multiple target image elements may be selected and manipulated 
using the techniques of the invention. 



Aspects of the present invention have been described by way of example only 
15 and it should be appreciated that modifications and additions may be made 
thereto without departing from the scope thereof. 
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CLAIMS 

1. A method of manipulating the visibility of a target image element displayed 
on a screen of a multi-screen display including the steps: 

a. Selecting at least one target image element; 

b. Identifying the screen on which the target image element is displayed 
and the position of the target image element on the screen; 

c. Manipulating the transparency of the target image element to the 
desired level, using one or more of the following: 

i. Manipulating the characteristics of the target element image to 
adjust its transparency; 

ii. Identifying partially overlapping image elements in 
substantially the same position on a different screen to the 
target image element and manipulating the characteristics of 
the overlapping image elements to adjust the transparency of 
the target image element; 

iii. Placing a supporting image element in substantially the same 
position on the same or different a screen from the target 
image element. 

2. A method according to claim 1, wherein the characteristics of the image 
elements to be manipulated are selected from, but not limited to, alpha 
values; colour; hue; saturation; brightness; or RGB values. 

3. A method according to claim 1 or claim 2, wherein supporting image 
element is a shadow or a mask. 

4. A method according to any one of claims 1 to 3, wherein the visibility of a 
target image element displayed on the front screen of a multi-screen display 
is increased by : 
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a. Increasing the alpha value of the target image element; 

b. Decreasing the alpha value of any other overlapping image elements; 

c. Introducing, or increasing the alpha value of, a shadow on a screen 
behind the target image element; 

5 d. Decreasing the alpha value of any mask overlapping the target image 

element on the front screen; or 

e. Any combination of a) to d). 

5. A method according to any one of claims 1 to 3, wherein the visibility of a 
target image element displayed on the rear screen of a multi-screen display 

10 is increased by : 

a. Increasing the alpha value of the target image element; 

b. Decreasing the alpha value of any overlapping image element; 

c. Introducing or increasing the alpha value of a mask on a screen in 
front of the rear screen; 

15 d. Decreasing the alpha value of any shadow overlapping the target 

image element on the rear screen; or 

e. Any combination of a) to d). 

6. A method according to any one of the previous claims wherein all image 
elements on a screen are selected as target image elements are limited to 

20 selected image elements or parts thereof. 

7. A method according to any one of the previous claims wherein the selection 
of a target image element may be conducted by a user or by a software 
programme. 

8. A method according to any one of the previous claims that is conducted by a 
25 user or by a software programme. 
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